Composing graphical models with neural networks for structured representations and fast inference
نویسندگان
چکیده
We propose a general modeling and inference framework that combines the complementary strengths of probabilistic graphical models and deep learning methods. Our model family composes latent graphical models with neural network observation likelihoods. For inference, we use recognition networks to produce local evidence potentials, then combine them with the model distribution using efficient message-passing algorithms. All components are trained simultaneously with a single stochastic variational inference objective. We illustrate this framework by automatically segmenting and categorizing mouse behavior from raw depth video, and demonstrate several other example models.
منابع مشابه
Structured Attention Networks
Attention networks have proven to be an effective approach for embedding categorical inference within a deep neural network. However, for many tasks we may want to model richer structural dependencies without abandoning end-to-end training. In this work, we experiment with incorporating richer structural distributions, encoded using graphical models, within deep networks. We show that these str...
متن کاملG Raphical M Odels with S Tructured F Actors , N Eural F Actors , and a Pproximation - Aware T Raining
This thesis broadens the space of rich yet practical models for structured prediction. Weintroduce a general framework for modeling with four ingredients: (1) latent variables,(2) structural constraints, (3) learned (neural) feature representations of the inputs, and(4) training that takes the approximations made during inference into account. The thesisbuilds up to this framewo...
متن کاملN EURAL F ACTORS , AND A PPROXIMATION - AWARE T RAINING by Matthew
This thesis broadens the space of rich yet practical models for structured prediction. Weintroduce a general framework for modeling with four ingredients: (1) latent variables,(2) structural constraints, (3) learned (neural) feature representations of the inputs, and(4) training that takes the approximations made during inference into account. The thesisbuilds up to this framewo...
متن کاملGenerative Adversarial Structured Networks
We propose a technique that combines generative adversarial networks with probabilistic graphical models to explicitly model dependencies in structured distributions. Generative adversarial structured networks (GASNs) produce samples by passing random inputs through a neural network to construct the potentials of a graphical model; maximum a-posteriori inference in this graphical model then yie...
متن کاملNon-parametric Structured Output Networks
Deep neural networks (DNNs) and probabilistic graphical models (PGMs) are the two main tools for statistical modeling. While DNNs provide the ability to model rich and complex relationships between input and output variables, PGMs provide the ability to encode dependencies among the output variables themselves. End-to-end training methods for models with structured graphical dependencies on top...
متن کامل